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ABSTRACT 

This is the first of a series of reports to be 
issued at irregular intervals to communicate the plans, progress, and 
findings of the evaluation of the Trainers of Teacher Trainers (TTT) 
Program. The first 12 pages of the report outline in three general 
categories the activities carried out to date; 1) visits to cluster 
meetings and individual projects and conversations with key people 
connected with TTT; 2) staff meetings to bring together the results 
of information collected during visits; 3) the preliminarydevelopment 
of interview schedules, questionnaires, and observational techniques. 
The remainder of the report contains the data-gathering devices that 
have been developed: the Cluster Meeting Observation Form, the TTT 
Cluster Meeting and Clustering Questionnaire, the Cluster Meeting 
Registration Form, the Site Visitor Briefing Postal Cards, the Site 
Visitor Questionnaire, and the Site Visitor Briefing Session 
Observation Instrument. (RT) 



o 

ERLC 



EDO 41 832 



it- 

i 



.0' . 

• tSC’ ' 



x'W 



j# ' 
' . ’ 

./ 

■/< ’ 



. -0 



v../ 

■ /? 



APERIODIC REPORT 



Xi-O- 







£ ' 



NO. 1 



TTT EVALUATION PROGRESS REPORT 
December 1969 



U,S, DEPARTMENT OF HEALTH, EDUCATION 
8t WELFARE 

OFFICE OF EDUCATION 

this document has been reproduced 

EXACTLY AS RECEIVED FROM THE PERSON OR 
ORGANIZATION ORIGINATING IT POINTS OF 
VIEW OR OPINIONS STATED DO NOT NECES- 
SARILY REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY 






v 4 

j 'm< 



■ " :*;*,/*;*• \% 



r .. : 




■.j * . ■ .j ; v i>’ Yw 

4-,: 









' :J I- 






r., ■* 



:v ' l! •? 



V 






* Submitted to 

CONSORTIUM OF PROFESSIONAL ASSOCIATIONS 
for Study of Special Teacher Improvement Programs 

/ ■} '■/; ::'v ' ■ 'z - 

' :r ; ^ w : ' ' “ ■ ^ 



"rii-K-'A 









.. T ‘i-k® 



A 



•’ ,:v T V W 

> * ^ Vij 



\\. v 

\\ r; 



. 4 



\ '■ , . ■*- -r <■ ■ 



(CIRCE) 






,/> \ 



./ 



' 4 ; 






:v tfkV • 



.. , .... . . .* ■ .... .... ... ,,, , .JU ■ , ■ . 

A ' y &f * 4 - . 

*.-V . ^ -VW 



f .'4 ’ 



'Tfe 



L >• y- ‘-2 ' 'At 




v^'^'4 ■ - ' 













EVALUATION STAFF 



J. Thomas Hastings, Director 
Arden Grotelueschen, Associate Director 
Douglas D. Sjogren, Associate Director 

Assistants 

David N. Addison 
Clencie L. Cotton 
Peggy E. Lents 
Margaret H. Pjojian 
Gary A. Storm 




EDO 41 852 



APERIODIC REPORT: TRAINERS OF TEACHER TRAINERS (ITT) EVALUATION 



U.S. DEPARTMENT OF HEALTH, EDUCATION 
& WELFARE 

OFFICE OF EDUCATION 
THIS DOCUMENT HAS BEEN REPRODUCED 
EXACTLY AS RECEIVED FROMTHE PERSON OR 
ORGANIZATION ORIGINATING IT. POINTS OF 
VIEW OR OPINIONS STATED TO NOT NECES- 
SARILY REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY. 



NO. 1 

ITT EVALUATION PROGRESS REPORT 
December 1969 



A brief progress report about the evaluation of the 
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PREFACE TO THE SERIES 








This report is the first of a series designed to communicate the 
plans, the progress, the instrumentation, and the findings of the evalu- 
ation of the Trainers of Teacher Trainers (TTT) Program conducted by the 
Center for Instructional Research and Curriculum Evaluation (CIRCE). 

There are several audiences for these reports, and for each audience 
a given report may serve different purposes. Of necessity a primary 
audience is the funding agency for this evaluation endeavor, the Consort- 
ium for Professional Associations (CONPASS). Another important audience 
is the U. S. Office of Education, Division of College Programs, TTT 
Branch. 

These primary recipients of the reports may share the reports with 
selected secondary audiences (e.g., TTT Project Directors, Association 
of Ame rican Geographers). The specific use made of each report by the 
primary or secondary audience is dependent upon the extent to which a 
report provides information relevant to the needs of the specific group. 
For example, the following Progress Report — of which a preliminary 
report was presented to the CONPASS Board in October, 1969 may be 
used by CONPASS simply to monitor their project. They also may use it 
as a basis for suggesting special aspects they would like studied. The 
Division of College Programs, USOE, on the other hand, may find it use- 
ful to demonstrate to the hierarchy the types of information being 
generated for assessing the total program. A future report on clustering 
might be used by CONPASS as a partial basis for discussion of interdis- 
ciplinary efforts, since clusters are for the most part mixed in subject 
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focus. The same report may be used by the Division of College Programs 
for assessment of goal accomplishment, while the TTT Program Director in 
the Division of College Programs might want to use it as a means for 
altering certain cluster activities. 

There is little point in issuing reports on a periodic basis — 
biweekly, monthly, quarterly — unless useable information is received 
and needs for this information occur at regular intervals. Ooviously 
either case rarely occurs. Reports in this series will appear as soon 
as relevant information is at hand. Hopefully the obtained information 
will be timely to the audience (s) for whom it was prepared. This means 
that the. reports will be aperiodic. On some occasions one will follow 
another within a very short interval; in other cases, a month or two 
may elapse. We certainly cannot now foresee the situation in which more 
than three to four months would pass without reportable information. 

For the present funding period, it is our expectation that as many 
as nine or as few as five reports will be made. Some reports now visioned 
as two separate reports might be printed as one report. 



J. T. H. 
A. D. G. 
D. D. S. 
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PROGRESS REPORT 



CIRCE started its evaluation work on the TTT program in February 
1969. The first thing we had to do was to see how the expectations we 
drew from the literature and history of TTT corresponded to the claims 
of purpose and intent voiced in the field — ±*e , , by those who have 
projects. The second thing, not unrelated, was to ascertain what some 
of the significant variables might be — that is, what variables are of 
practical value to those who have projects in the program. At that point 
in time it seemed useful — and now we are convinced that it was useful — 
to make all of the observations we could (without being evaluative) of 
the various component parts of TTT: projects which were operational in 
the su mme r of 1969, cluster meetings, and the LTI. Another purpose for 
visiting various components was that of getting people in the projects 
to view us as a group which might be helpful, as opposed to perceiving 
us as spies or as individuals who would have a major effect on the fund- 
ing of individual projects. We have reason to believe, largely because 
of the kinds of questions we are asking and the apparent openness of the 
responses we have received from those Involved in local projects, that 
this second purpose has been accomplished in the majority of cases. 

One of the problems we have faced grows from the large number of 
requests we have received from TTT projects to participate in or consult 
on evaluation activities at the local level. Putting aside the matter of 
available time, we have agreed within the evaluation team that it would 
net be appropriate for any of us (nor for anyone in CIRCE) to work on 
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local-project evaluation plans. There is too much possibility of mis- 
understanding our effects on funding. Consequently, we have had to refer 
requests for help from local projects in need of evaluation to persons 
or agencies with capabilities of extending help. 

Activities 

There have been three distinct types of activity: (1) visits to 

meetings and projects and conversations with key people connected with 
TTT; (2) staff meetings to bring together the results of information 
collected in visitations along with our study of documents in order to 
plan effectively the over-all instrumentation and points of focus; and 
(3) the preliminary development of interview schedules and questionnaires 
as well as observational techniques. These activities are described 
briefly in that order in the following pages of this section. 

Visits 

LTI. In March and again in August individuals from the evaluation 
team had interviews with Dr. Harry Rivlin, Chairman of TTT LTI. Dr. 

Terry Denny interviewed on the first occasion, and Mr. David Addison did 
the second interview. From these we obtained information regarding the 
functions and strategies of LTI, the basic purposes and modes of function- 
ing of the TTT program,, and the input to the total program of community 
groups . 

On September 27, Dr. Arden Grotelueschen and Dr. J. Thomas Hastings 
attended an LTI meeting in Washington in which plans were further 
formulated for the November site visits to projects. On October 22 and 
23 a team of participant observers (Dr. Arden Grotelueschen, Dr. Douglas 



Sjogren, Mr. Clencie Cotton, Miss Margaret Pjojian, Mr. Gary Storm) 
attended the LIT site visitors briefing in Chicago. Systematic observa- 
tions were made of most aspects of this meeting by the observers. Such 

meetings are very important to us for the insights into the objects of 

/ 

concern in the program. 

USOE-BEPD . Various members of the staff have visited with the 

personnel in BEPD who are directing and monitoring the program. Dr. 
Hastings spent time on several occasions during the summer with Dr. Daniel 
Bernd. In September Dr. Arden Grotelueschen and Dr. Douglas Sjogren vis- 
ited with the following people: Dr. Dustin Wilson, who is directing the 

section dealing with TTT; his Deputy Director, Dr. Mary Jane Smalley; and 
two people in that office who helped them locate documents, Lorna Polk 
and Shirley Radcliffe. On that visit the two read all available prospec- 
tuses from "places" which were seeking funding for the next fiscal period. 

CIRCE-0 1 Hare Meeting . On July 28 a meeting was held at O' Hare Air- 
port by the CIRCE evaluation group with people from USOE and from CONPASS. 
The following people were present: from USOE — Daniel Bernd, Donald 

Bigelow, Frank McLain, Nathan Pitts, Allen Schmieder; from CONPASS — 

Saul Cohen, Joseph Palaia; from the Tri-University Project — Gabriel 
Della-Piana; from CIRCE — David Addison, Terry Denny, Dennis Gooler, 

Arden Grotelueschen, J. Thomas Hastings, Martin Maehr, Joyce Riley, 

Douglas Sjogren, Lois Williamson. The purpose of that meeting was to 
elicit more information on the expectations for TTT and to discuss the 
evaluation of TTT. 

Grove Park Institute . Mrs. Joyce Riley was an observer for the eval- 
uation team at the June 10 - 15 meeting held by CONPASS at Asheville, 
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North Carolina. Although we knew that we would gel to study the report 
of the meeting, it was useful to have a person from the staff present 
for the collection of impressions and specific descriptions. Although 
the meeting was not on the TXT program, many of the ideas expressed there 
relate to that operation. 

Bertram Masia . Since Dr. Masia conducted the beginning phase of 
the TTT evaluation, we have studied his first partial report given at the 
ETS Invitational Conference on Testing Problems in New York City last 
October. Also, Mrs. Joyce Riley had an interview with Dr, Masia in 

Cleveland on May 12, 1969. 

Cluster Meetings . We have been diligent in attending cluster meet- 
ings. Not only are these good situations in which to find out more about 
individual projects and the program as a whole, but the "cluster" idea is 
a very real force in the national program. The following cluster meetings 
have been visited by the person(s) designated: 



West Coast, San Diego, California 


June 27-28 


Terry Denny 


Southern and Appalachian, 
Atlanta, Georgia 


July 24-25 


Thomas Hastings 
Terry Denny 


Southwestern, Denver, Colorado 


July 25 '27 


Douglas Sjogren 
Thomas Hastings 


Midwest, Chicago, Illinois 


July 28-29 


Terry Denny 


Northeastern, New York City 


October 2-4 


Arden Grotelueschen 
David Addison 


Midwest, Minneapolis, Minnesota 


November 5-7 


Douglas Sjogren 
Clencie Cotton 


West Coast, Seattle, Washington 


November 7-9 


Gary Storm 
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Projects . Our intent in visiting individual projects is not for the 
purpose of evaluating the local project. Our purpose is to take that sort 
of first-hand look which helps give meaning to verbal descriptions of 
projects. The following visits to specific sites have been made: 



University of Nebraska, 
Dr. Paul Olson 



July 



Martin Maehr 



University of Illinois, 

mathematics, English, education 

University of Miami, 

Dr. Gerald Faust 

University of West Virginia, 
Morgantown 



July 

July 14-15 
August 10-11 



Terry Denny 

Dennis Gooler 
Joyce Riley 

David Addison 
Joyce Riley 



S taff Meetings 

Staff meetings were held at least once every two weeks in the early 
stages of the evaluation work. Since September they have been held weekly. 
By the end of September we had conceptualized an over-all evaluation plan, 
i.e., areas of focus, sources of data, times for collection, and types of 
analyses. More recently the weekly staff meetings have provided a means 
for coordinating the work efforts of the various members of the evaluation 
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Instrument Development 

A number of instruments have been developed, and are currently being 
used as data gathering devices. Other instruments are in different prelim- 
inary stages. 

Those instruments that have been developed are the Cluster Meeting 
Observation Form (Appendix A), the TTT Cluster Meeting and Clustering 
Questionnaire (Appendix B), the Cluster Meeting Registration Form (Appen- 
dix C) , the Site Visitor Briefing Postal Cards (Appendix D) , the Site 
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Visitor Questionnaire (Appendix E) , and the Site Visitor Briefing Session 
Observation Instrument (somewhat similar to the Cluster Meeting Observa- 
tion Form but uneconomical to exhibit separately) . 

It is anticipated that a phone interview schedule for cluster direc- 
tors about clustering activities and for project directors about project 
level information will be developed in the near future. Also, a compre- 
hensive project level interview schedule will quite possibly be developed 
in the next few iionths. 

EVALUATION PLAN 

The following material contains a summarization of the various data 
gathering activities that will have occurred by June 30, 1970. Each of 
the components is described in some detail and include a rationale for 
gathering the data and for the variables included in the instruments along 
with a tentative time schedule for each component. 

Clustering 

During this year the six clusters of the TTT program were formed. 
There were apparently two primary purposes for the clusters. One purpose 
was to have the clusters serve as a medium for project monitoring by 
U« S.O.E. The other purpose was that the clusters would facilitate com- 
munication and dissemination among the TTT projects. We regard the 
clustering activity as an important transaction or process of the TTT 
program and consequently an important component on which we should gather 
data. The main purpose of our data gathering is to attempt to determine 
whether the intended purposes for the clusters are being attained. At 
the same time, however, we are also gathering data on who is participating 



in the cluster activity, what types of clustering are occurring, what 
are the perceptions and attitudes of the various participants toward the 
cluster, and what is occurring in the cluster meetings. These variables 
may very possibly relate to the success of the cluster component. 

Our data gathering with respect to clustering has consisted of the 
following : 

1. We have had an observer or observers at all but two cluster 
meetings to observe and report on what occurred in the cluster meetings. 
Data have been gathered by use of the Cluster Meeting Observation Form 
(Appendix A). We expect to continue with this kind of data gathering 
activity. 

2. We are now receiving completed responses obtained from the 
TTT Cluster Meeting and Clustering Questionnaire (Appendix B) that was 
sent to a randomly selected sample of cluster meeting participants and 
to all project directors who attended the most recent cluster meeting 
held by a cluster prior to December 1. Sixty-two per cent (109 out of 
175) of the questionnaires have returned from a first mailing and a 
follow-up letter has been mailed to persons who have not returned their 
questionnaires . 

3. A Cluster Meeting Registration Form (Appendix C) was developed 
for use in forthcoming cluster meetings. That is, the January meetings 
of the Southwestern (Houston) and the Social Science (New Orleans) are 
expected to be the first meetings in which this instrument will be used. 
The purpose of the instrument is to provide descriptive data of cluster 
meeting participants. 




4. We are planning a telephone interview of cluster directors to 
occur during the last part of January in which we will ask many of the 
same questions as asked of the participants. In addition, questions 
on the administration of the cluster component, cluster training functions, 
relations with other components such as LTI, U.S.O.E., etc. will be 
ascertained. 

5. A CIRCE representative (Dr. Hastings) attended the meeting of 
TTT cluster directors and U.S.O.E. personnel in New Orleans in December. 

A summary of this meeting has been prepared for intra-office use. 

We expect to prepare a preliminary report on clustering by the first 
part of February. This report will contain a presentation of the question- 
naire data. An Aperiodic Report on clustering is planned for the end of 
February. This report will include an analysis and discussion of all 
available data on the clustering component. 

Site Visit 

Another important process or transaction of the TTT program was the 
LTI site visit component which occurred in November and December. About 
150 persons went in teams of four or five to visit TTT projects. Each 
team visited one project and each member of the team reported on the 
visit. The site visitors had little or no contact with TTT prior to the 
site visit. The site visitors met in Chicago on the 22nd and 23rd of 
October for an orientation session and the visits occurred after this 
session. The purposes of the site visit appeared to be to disseminate 
the concept of TTT to a wide and influential audience, to identify a 
talent pool for TTT projects, and to provide advice and counsel to project 
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directors. The extent to which these purposes were achieved appears to 
be an important variable about which data might be gathered . 

It was felt that the site visit was a significant activity and should 
receive attention from the program evaluators. The. following list indicates 
the data gathering activities that have occurred or are in progress for 
the site visit component. 

1. Five evaluation staff members participated in the LTI site visitor 
briefing as observers. Observations were recorded independently by each 
observer using a specially prepared Site Visitory Briefing Session Obser- 
vation Instrument. 

2. Information concerning knowledge, understandings, and attitudes 
of the participants at the site visitor briefing sessions was obtained 
about a number of topics concerning TTT in general, site visiting and 
the role of the participants in it, and the effectiveness of the site 
visitor briefing sessions themselves. Each participant received one of 
tan different postal cards from the evaluation staff four days 'after the 
meeting. (See Appendix D for copies of these cards.) Each postal card 
contained from one to five items, some requiring objective, and others 
open-ended , responses . Each of the ten n sub— questionnaires was sent to 
an almost equal number of representatives from each of the four parity 
groups (education, liberal arts, schools, and community). The total 
number of postal cards mailed was 164. Of these 117 (71%) were returned. 

No follow-up was made of non-respondents. 

3. A Site Visitor Questionnaire (Appendix E) is being sent to the 
site visitors during the week of January 19 in which questions are asked 
of relevance to the purposes of the site visit. Thus the visitors are 
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asked to respond with their perceptions and attitude toward various 
aspects of the project they visited and to the TTT national program. 

4. It is anticipated that project directors will be asked to 
respond with their impressions of the site visit and the report made 
by the visitors when data is gathered by the evaluation staff at the 

project level. 

5. The Crockett report based on the site visitors reports as well 
as the individual site visitor reports will be provided us in the near 
future. 

Except for the data from the project directors, it is our intention 
to present an analysis and discussion of the site visit data in an 
Aperiodic Report to be issued around the end of February. We hope also 
to have an earlier preliminary report of the data on impressions of TTT 
by the site visitors, possibly by February 13. 

Project Information 

The project level is where the degree of success of the TTT program 
is determined, and certainly our greatest evaluative efforts should be at 
this level. In October we were planning for a data gathering effort at 
the project level in December and January. The site visit occurred, how- 
ever, and we felt that it would not be desirable to attempt to gather 
data when the site visits were occurring. Consequently, we postponed 
data gathering at the project level and concentrated on getting data on 

the site visit and cluster activities. 

Our data gathering activity plans at the project level are described 

as follows: 

1. A few projects were visited last summer and we have reports from 
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persons visiting these projects* These visits were mere for the purpose 
of identifying variables and familiarizing the staff to project activities 
than data gathering per se. Consequently the reports are not intended to 

be used in any other way. 

2. At the present time we are classifying projects according to 
certain descriptors such as location, operational-planning, support 
level, focus, base of operation, etc. We are concentrating our efforts 
on those projects that will continue into 1970—71. We expect to 
complete these descriptions during the week of January 26. 

3. When we decided to postpone the data gathering at the project 
level we intended to do this in March and April, 1970. The program of- 
ficers have indicated a desire for certain preliminary data on the projects 
in February. An attempt will be made to conduct a phone interview of 
approximately 10 project directors during the first part of February. We 
will select 10 projects that are operational this year and will continue 

to be operational next year. In the interview we intend to collect inform- 
ation about characteristics of participants and staff, institutional 
arrangements for the TTT project, how the project is administered, how 
parity is being handled, what curricular changes have been achieved, etc. 
It is felt that these data will be helpful for determining whether these 
projects are having an impact on the teacher education program in the 
institution — an important gocl of the TTT program. The instrument for 
the phone interviews has not yet been developed. A preliminary report of 
the data obtained in the project level phone interviews will hopefully be 
made by the middle of February. 
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4. Extensive data gathering at the project level will occur in 
March and April. We will gather data at the project level on those 
variables described above of relevance and others that are shown to be 
of significance in instrument tryout. We intend to obtain data from 
project directors, project staff, advisory committee members, university 
and school administrators, and participants either by interview or 
questionnaire. Attempts will be made where applicable to gather data 
across parity groups. We expect to employ an interviewer from the geo- 
graphic area of a number of projects to gather the data for us after 
he has been trained by us. We anticipate employing from five to eight 

such persons. 

In addition we have two black persons on our staff who will conduct 
a study of community reaction to the TTT projects. Several studies have 
indicated that honesty of response is related to a perceived similarity 
or empathy between interviewer and respondent. We feel it is essential 
to use black interviewers and questioners when asking questions of the 
black community which is a dominant minority group in TTT. 

All of the data at the project level will be presented in an 
Aperiodic Report to be issued about the end of May. As project level 
instruments are developed we hope to be able to discuss them with the 
personnel in U.S.O.E. 




APPENDIX A: Cluster Meeting Observation Form 
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CLUSTER MEETING OBSERVATION FORM 
Trainers of Teacher Trainers Evaluation 

Cluster — — 

Meeting Location — - 

Meeting Dates — — 

This is the meeting of this cluster. 

Observer 

i 

Instructions 

Be sure to obtain a copy of all hand-out material at the meeting. A list 
of participants and the agenda are very important. 

The questions on this form should be answered after you have attended 
a session. It would be well to become very familiar with the questions before 
you attend the meeting, but we suggest that you not use the form during the 
meeting. We suggest, rather, that you take notes during the meeting as 
though you were a participant and then complete the forms in your room using 
your notes and your memory- One form should be completed for each session 
listed on the agenda. Forms are also provided for recording information 
about other things like conversations, bull sessions, ad hoc meetings, etc. 

It is important that the observer describe accurately the events of 
the cluster meeting. If observer impressions or opinions are made, they 
should be labeled as such. 
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formal SESSION NO. 



Location 



Time 



Date 



1. Type of session! ( Circle one) Lecture, Lecture-discussion, Discussion, 

Panel, Workshop, Reporting, Other 



(specify) 

2. Organization: Total group, half of the group, small group 



3. Number of people in attendance: 

Male 



Female 



USOE 



White 

Community 



Black 



Latin 



School 



Educ. 



LAS 



Student 



4. Person in charge of session: 

5. Room situation: 



r omments 



Seating : 


Adequate 


5 


4 


3 


2 


1 


Crowded 


Accoustics : 


Good 


5 


4 


3 


2 


1 


Bad 


Lighting: 


Adequate 


5 


4 


3 


2 


1 


Poor 


Comfort : 


Adequate 


5 


4 


3 


2 


1 


Poor 



6. Complete the following for each formal presentation. ( Go to Q . 7 if session 
did not have a formal presentation . ) 

Presenter No. 



Name (Mr., Mrs., Miss) 



Title/Position_ 



Length of presentation: 



Main points covered: 





(last) 


(first) 


(initial) 


n : 




(time started) 


(time ended) 


(length) 












\ 



Rating of presentation: 
Organization: Well organized 5 

Stimulation: Very stimulating 5 

Clarity: Clear 5 

Pacing: Well paced 5 



Audience reaction: 



Attentive : 
Hostility: 
Interest: 



Very attentive 

Sympathetic 

Interested 



5 

5 

5 



Questions : Much questioning 5 

General comments and impressions : 



4321 Poorly 
4 3 2 1 Dull 

4321 Unclear 
4321 Not well paced 



4321 Inattentive 
4321 Hostile 
4321 Disinterested 
4321 Little questioning 



What were the questions and the discussion about? 
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Presenter No. 

Name (Mr., Mrs., Miss) . . 

(last) (first) (initial) 



Title /Position 



Length of presentation: 

(time started) (time ended) (length) 



Topic of presentation: 
Main points covered: _ 



Rating of presentation: 

Organization: Well organized 5 

Stimulation: Very stimulating 5 

Clarity: Clear 5 

Pacing: Well paced 5 

Audience reaction: 

Attentive: Very attentive 5 

Hostility: Sympathetic 5 

Interest: Interested 5 

Questions: Much questioning 5 



General comments and impressions : 



4 3 2 
4 3 2 
4 3 2 
4 3 2 



1 Poorly 
1 Dull 
1 Unclear 
1 Not well paced 



4 

4 

4 

4 



3 2 

3 2 

3 2 

3 2 



1 Inattentive 
1 Hostile 
1 Disinterested 
1 Little questioning 






'■> •« . *<• .«■ n *. .-»-■■» * * ■' #>t . ,...*. ...... a. ■ 




5 



What were the questions and the discussion about? 



Presenter No. 

Name (Mr. , Mrs. , Miss) 

( las t ) (firs t) ( ini tial) 

Title/Position 

Length of presentation: 

(time started) (time ended) (length) 

Topic of presentation: 

Main points covered: 



Rating of presentation: 

Organization: Well organized 543 
Stimulation; Very stimulating 543 
Clarity: Clear 543 



Pacing : 



Well paced 



2 1 Poorly 

2 1 Dull 

2 1 Unclear 

2 1 Not well paced 
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Audience reaction: 

Attentive: Very attentive 


5 


4 


3 


2 


1 


Inattentive 


Hostility: 


Sympathetic 


5 


4 


3 


2 


1 


Hostile 


Interest: 


Interested 


5 


4 


3 


2 


1 


Disinterested 


Questions : 


Much questioning 


5 


4 


3 


2 


1 


Little questioning 


General comments 


i and impressions : 















What were the questions and the discussion about? 



7. Complete the following if Panel Discussion {Go to Q. 8 if not appropriate) . 

Name Position 



Members of the Panel: 



8. Complete the following if Workshop or Discussion Session. Summarize the 
workshop activity or the discussion topic, i.e., what went on in the 
session. . 



Was there a product of the session, e.g., a consensus report, a list of 
issues, a plan, etc.? Yes No 



(If yes) What was it in terms of content? 



INFORMAL ACTIVITIES 



1. Describe the setting 



2. What went on? 



3. List the salient points covered. 
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TTT CLUSTER MEETING AND CLUSTERING QUESTIONNAIRE 
Trainers of Teacher Trainers Evaluation 
Center for Instructional Research and Curriculum Evaluation 
270 Education Building, University of Illinois 
Urbana, Illinois 61801 

TO SELECTED CLUSTER MEETING PARTICIPANTS: 

There are many important aspects of the United States Office 
of Education TTT Program about which descriptions and judgments 
of worth might be made. As one facet in the evaluation of the 
TTT National Program, we at the Center for Instructional Research 
and Curriculum Evaluation (CIRCE) have prepared a Cluster Meeting 
and Clustering Questionnaire for a carefully selected sample of 
persons to complete. This questionnaire is designed to obtain 
some of your opinions about the most recent general cluster meet- 
ing which you attended and about TTT clustering in general. We 
realize the difficulty you might have in remembering specific 
impressions about this cluster meeting since it occurred some 
time ago, but we would like you to recall as best you can. 

The information that you provide in this questionnaire about 
this specific cluster meeting and about clustering will be of 
value to the TTT National Program Administrators. It is impor- 
tant that every participant who has been sent this form complete 
and return this questionnaire in the self-addressed return enve- 
lope, so the reactions of the total sample will be reflected. It 
is our estimate that you will be able to complete this form in 
approximately 15 minutes. 

We are asking you to indicate your name only to facilitate 
coordination of the returns. The questionnaire is completely 
confidential. Particular replies will be treated in summary form 
and names will not be associated with specific replies. Your 
cooperation is truly appreciated. Thank you. 



Name 



Mr. 

Mrs. 

Miss_ 



(last) 



Date 

(first) 



Address 

(street) (city) (state) (sip) 

Indicate where you attended your 

most recent general cluster meeting 

(city) (state) 



1 . With which one of the following parity groups do you 
primarily identify? (Check one) 



DO NOT 
WRITE 



Community 1 [ ] 

Education 2[ ] 

Liberal Arts 3[ ] 

Participant 4[ ] 

School 5[ ] 
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2. Within this primary parity role, what is your main 
working role in TTT? (Exclude cluster role.) 



Project Director . . 1[ ] 

LTI Member 2 [ ] 

Project Staff. . . . 3[ ] 
Other 



Student 4[ 

Advisory Member. 5[ 
Consultant . . . 6[ 
_____ . . 7[ 



( specify ) 



] 

] 

] 

] 
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3. Approximately what percent of your total working time 
is spent in your primary working role with TTT? 

Less than 25%. . . . 1[ ] 50% - 74%. . . . 3[ ] 

25% - 49% 2 [ ] 75% or more. . . 4[ ] 

4. Do you have a work role outside TTT? (Check one) 

Yes . . 1[ ] No . . 2 [ ] 



13 



14 



5. (If yes) Briefly indicate the firm or organiza- 
tion for whom you are employed. Give job title. 
Describe the nature and specific duties of your 
work activity. 



Firm 

Title 

Activity and duties 



( )15 

( M 

( )17 
( )18 



6. About what percent of your total working time is 
spent in this outside role? (Check one) 



Less than 25%. . . 1[ ] 50% - 74%. . 
25% - 49% 2 [ ] 75% or more. 



3[ ] 
4[ ] 



19 



7 . Prior to your attending the cluster meeting, how 
clear were the purposes of the meeting to you? 
(Civ ole one) 



5 4 

Very Quite 

Clear Clear 



3 2 1 
Somewhat Hardly Not 

Clear Clear Clear 



8. Was your initial reason for attending the cluster 
meeting a result of your own desire to attend the 
meeting, or to satisfy the request of someone else, 
or both? (Circle one) 



Your own desire to attend . * . 1[ ] 

At other person's request . . . 2[ ] 

Both 3 [ ] 

9 . (If only at other person's request) Identify this 
person by indicating his major role in TTT (e.g. , 
Cluster or Project Director). 



10. A few clusters have had more than one general meeting. 
Have you attended an earlier meeting besides the one 
you attended most recently? 

Yes . . . . 1[ ] No .... 2 [ ] 

11. (If yes) How would you rate this most recent 
meeting compared to the earlier one? 



Substantially better 1[ ] 

About the same ........ 2[ ] 

Substantially worse 3[ ] 



12 . If another cluster meeting were to be held, would you 
recommend attendance to others like yourself? 

Yes . . . . 1[ ] No . . . * 2[ ] 

13 . (If no) Why not? 




DO NOT 
WRITE 

20 

21 

( )22 

23 

24 

25 

( )26 
1 127 
( )28 



14 . Below are listed the major purposes of clustering. 
For each purpose, check the category that best indl 
cates the importance you personally place on it. 



DO NOT 
WRITE 



Very Somewhat Not 
Important Important Important 

A. To monitor and give 

direction to projects . [ ] E ] E 3 
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B. To coordinate projects 
for their mutual 

benefit El El El 

C. To disseminate infor- 
mation among program 

components [] El E 3 

B. To foster and establish 
a broad base of support 

for the program ....{] I ] 13 



30 

31 



32 



E. To stimulate exchange 

and interaction ...•[] El II 

F. To provide communica- 
tion between the 

project and USOE. . . • [ ] E ] E ] 

15 . In regard to the above purposes, circle the letters of 
those three purposes that you feel are considered most 





important by the USOE. 

ABODE 


F 




( )35 
( )36 
( )37 


16. 


For each of the above purposes 
feel they are presently being : 

Quite Well 


, indicate 
fulfilled. 

Somewhat 


how well you 
Not Well 




A . . . . 


I 1 


E ] 


t 3 
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B . . . . 


E 1 


E 1 


E 3 


39 




C . . . . 


E ] 


E ] 


E 3 


40 




B . . . . 


E 1 


[ 3 


E 3 


41 




E . . . . 


E ] 


E 3 


E 3 


42 




F % . . . 


E ] 


E 3 


E 3 


43 


17. 


In general, do you 
cluster activity? 


agree with 

(Circle one 


the purposes of the 






5 4 

Highly Quite 


3 

Somewhat 


2 

Hardly 


l 

Not at all 
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18 . Indicate the extent of your familiarity with the 

activities of your local TTT project and your famil- 
iarity with your cluster. 



Highly Quite Somewhat Hardly Not 
Familiar Familiar Familiar Familiar Familiar 
Project: [ ] [ ] [ ] [ ] [ ] 

Cluster: [ ] [ ] [ ] [ ] [ ] 

19 . Within your TTT cluster (but outside your project), 
think of one project activity, if any, that imp* esses 
you highly. Briefly describe this activity. 



20. Indicate how you initially became familiar with this 
project activity (e.g., newsletter, visitation, 
personal contact). 



21. To what extent have you interacted (verbally or 
through correspondence) with the personnel of this 
activity since finding out about it? (Circle one) 

5 4 3 2 1 

High Much Some Little No 

Interaction Interaction 

22 . Have there been any changes in your thinking, do you 
intend any changes in your project, or have changes 
been made in your project which could be attributed 
to this feature with which you have been impressed? 



Yes, change in thinking 1 [ ] 

Yes, change in thinking and intended 

change in project 2 [ ] 

Yes, change in thinking and actual 

change in project 3 [ ] 



No change in thinking, no intended change, 

and no actual change in project . . . 4 [ ] 

23 . (If yes) Specify the change and its substance. 



DO NOT 
WRITE 



45 

46 



( )47 
048 
( )49 



( )5Q 



51 



52 



( >53 
( )54 



DO NOT 

24. To the best of your knowledge, indicate the extent to WRITE 
which parity is being achieved in each situation 
listed below. (Check one for each situation) 





For the 


Some- 


Little, 






most part 


what 


if any 




Your project planning 


[ 1 


[ ] 


[ ] 
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Your project operation 


[ ] 


[ ] 


[ ] 


56 


Cluster meeting planning 


[ ] 


[ ] 


[ ] 


57 


Cluster meeting program 


[ ] 


[ ] 


[ 1 
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25. For each of Project planning and Project operation, 
indicate the extent to which you estimate your proj- 
ect will be able to deliver parity in the next one to 
two years. 





Project 


Project 




Planning 


Operation 


Substantially . 


. . [ ] 


[ ] 


Moderately. . . 


. . [ ] 


[ ] 


Somewhat. . . . 


. . [ ] 


[ 3 


Little 


. . [ ] 


[ 3 


Not at all. . . 


. . [ ] 


[ 3 



26. To what degree are you satisfied with the present 
organisational structure of your cluster, which is 
basically geographic? 

5 4 3 2 1 

Highly Quite Somewhat Little Not at all 

27 .(If not at least quite satisfied) Indicate the 
structural arrangement that you would recommend 
for reorganizing the present cluster (e.g., 
topical, size of project, city-rural). 



61 



( )62 



28. Are you aware of your project's involvement in the 
sharing of resources (personnel, materials, ideas) 
with other projects? 

Yes . . . . 1 [ ] No .... 2 [ ] 63 

29. (If yes) What specific resources have been shared 
between your project and others? 

( ) 64 
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30. The following items have been prepared so that you can 
indicate how you feel about important aspects of TTT. 
In each case, circle the letter which represents your 
reaction as to whether you Strongly Agree (SA) , Agree 
(A), are Neutral (N), Disagree (D) , or Strongly Dis- 
agree (SD). If you would like to clarify your answer, 
please do so. 

A. Too much emphasis has been 

placed on parity in TTT. . . . SA A N D SD 



B. I would like to meet with 
people in other projects 

outside of my cluster SA A N D SD 



C. Educationists are overly 
concerned with their 
professional role in 

teacher education SA A N D SD 



D. The project with which I am 
associated has not fulfilled 

the hopes I had for it .... SA A N D SD 



E. I made new contacts useful 
to me in my role in TTT at 

the cluster meeting SA A N D SD 



F. The liberal arts and science 
people are truly involved in 
the teacher-education 

programs SA A N D SD 



G. My attitude about TTT is one 

of enthusiasm SA A N D SD 



DO NOT 
WRITE 



65 



66 



67 



68 



69 



70 



71 
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H. I do not see the value in my 

attending cluster meetings. . SA A N D SD 



I. Too little attention has been 
given in TTT to the culturally 

different SA A N D SD 



J. In my opinion clustering has 
greatly increased the communi- 
cation among TTT projects . . SA A N D SD 



K. I would prefer to be in a 

cluster in which the projects 

were similar to ours SA A N D SD 



L. The cluster meeting was timely 
in terms of activities at the 
TTT project in which I am 

directly involved SA A N D SD 



M. Most demands of the community 

people are reasonable . . . . SA A N D SD 



N. The purposes of the cluster 

meeting were clear to me. . . SA A N D SD 



0. The schools are the place for 

teacher education to happen . SA A N D SD 



P. In general, the topics presented 
and discussed at the cluster 
meeting were not relevant to 

me in my position in TTT. . . SA A N D SD 



DO NOT 
WRITE 
72 



73 



74 



75 



76 



77 



78 



79 






80 
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CLUSTER MEETING REGISTRATION FORM 

Trainers of Teacher Trainers Program 



C& 



1. Name (Mr., Mrs., Miss) 



(last) 



(first) 



2. Address 



(street) 



(city) 



(state) 



(zip) 



3. Telephone Date 

(area code) (number) (month) (day) (year) 

4. How many Cluster Meetings have you attended previously? 

None ....[] One . . . . [ ] Two . . . . [ ] Three or more . . [ ] 

5. Identify the TTT Project with which you are connected, if any. 



* 



6. With which one of the following parity groups do you primarily identify? (Check one) 

Community [ ] 

Teacher Education . • • [ ] 

Liberal Arts [ J 

Participant [ j 

School [ ] 

7. Within this primary parity role, what is your main working role in TTT? 



Cluster Director . . . [ ] USOE Staff. .....[] 

Project Director . . . [ ] Student [ ] 

LTI Member [ ] Advisory Member . . . [ ] 

Project Staff [ ] Consultant [ ] 

Other • • [ ] 

(specify) 



8. Approximately what percent of your total working time is spent in your primary role with TTT? 



Less than 25% [ ] 50% - 74% [ ] 

25% - 49% .......[ ] 75% or more [ ] 



9. Approximately how long have you been affiliated with TTT in this capacity? 



10. Do you have a work role outside TTT? (Check one) Yes . . . [ ] No • • . [ ] 

11. (If yes) Briefly indicate the firm or organization for whom you are employed. Give job 
title. Describe the nature and specific duties of your work activity. 

Institution or Firm 

Title 

t 

Activity and duties 



12. About what percent of your total working time is spent in this outside role? (Check one) 



Less than 25% [ ] 50% -74% I ] 

25% - 49% I ] 75% or more I J 
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APPENDIX E: Site Visitor Questionnaire 
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SITE VISITOR QUESTIONNAIRE 

Trainers of Teacher Trainers Evaluation 

This questionnaire is completely confidential.; Re- 
sponses will be treated in summary form and names will 
not be associated with specific replies. Names are to be 
provided only to facilitate coordination of returns. 



1. Name 



Date 



(last) 



(first) 



2. Had you heard of TTT prior to your being contacted to 
serve as a site visitor? 

Yes . . . 1[ ] No . . . 2[ ] 

3. (If yes) Indicate the primary source. 



4. In addition to participation as a site visitor, do you 
have a direct connection with any aspect of the TTT 
program? 

Yes . . . 1[ ] No . . . 2[ ] 

5. Personally, how would you characterize the purpose of 
the site visit? (Check no more than two or three) 

A. To make a judgment about whether a 

project should be refunded 1[ ] 

B. To assist the project staff in viewing 

their own activities from an outsider's 
perspective 2[ ] 

C. To evaluate the effectiveness of the 

TTT National Program . . . 3[ ] 

D. To describe what the project is doing 

and how it is doing it 4[ J 

E. To learn more about the TTT National 

Program . . . . 5 [ ] 

6. How much impact do you think your visit had on the 
project you visited? (Circle the number) 

1 2 3 4 5 

Great Much Some Little No 

Impact Impact Impact Impact Impact 



DO NOT 
WRITE 



11 



( )12 

( )13 



14 



15 



16 



17 



18 



19 



20 



ERJC 

.hmflaffHHaaaa 



7. Indicate one important way your visit affected the 
project you visited. 



| DO MOT 
WRITE 



( )21 
( )22 



8. To what extent is the project you visited making 
progress toward the goal of involving community . 
people in the task of training better teachers? 



1 2 3 4 0 

Much Some Little No No 

Progress Progress Progress Progress Knowledge 

9. . . . toward the goal of involving arts and science 

people . . . ? 

1 2 3 4 0 

Much Some Little No No 

Progress Progress Progress Progress Knowledge 

10. . . . toward the goal of involving public school 
people . . . ? 

1 2 3 4 0 

Much Some Little No No 

Progress Progress Progress Progress Knowledge 

11. . . . toward the goal of involving TTT participants 
(students) . . . ? 

1 2 3 4 0 

Much Some Little No No 

Progress Progress Progress Progress Knowledge 

12. Relative to other federally supported educational 
programs, how would you rate the social relevance 
of the TTT program? 



More relevant than any other 1[ ] 

More relevant than most 2[ ] 

Of average relevance 3[ ] 

Less relevant than most 4[ ] 

Least relevant 5[ ] 
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24 



25 



26 



27 
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13. The primary focus of the TTT project I visited is on 
training teachers to better serve our educationally 
disadvantaged population. 

True . . 1[ ] False . . 2[ ] Undecided . . 3[ ] 

14. Ignoring for a moment the social orientation of the 
TTT project you visited, how would you rate the over- 
all educational merit of this project? 

1 2 3 4 5 

Very High High Average Low Very Low 

Merit Merit Merit Merit Merit 

15. A project might or might not have "educational merit," 
but would you consider the project you visited to be 
educationally innovative ? 

1 2 3 4 5 

Extremely Rather Somewhat Hardly Not at all 

Innovative Innovative Innovative Innovative Innovative 

16. (If at least somewhat innovative) Name one major 

way. 



17, Do you think TTT projects are doing a good job of 

training educational change agents : people who will 

be able to bring about changes in education in the 
future? 



Yes, very good job 1[ ] 

Yes, fairly good job 2[ ] 

Average job. . 3 [ ] 

No, fairly poor job 4[ ] 

No, very poor job. 5[ ] 



18. Relative to other teacher training programs you know 
about, how does TTT compare? 



It is generally better . 1[ ] 

It is about the same 2[ ] 

It is generally poorer - 3[ ] 

No basis for comparing 4[ ] 



DO NOT 
WRITE 
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30 



( )31 
( )32 



33 



34 



19. How do you sea the concept of TTT broadly influencing 
the training of teachers? 

1 2 3 4 5 

Highly Much Some Little Not at all 

20. My attitude toward federally supported programs is 
more favorable than it was before making the site 
visit . 

Agree . . 1[ ] Disagree . . 2[ ] Undecided . . 3[ ] 

21. Have you made a continuing commitment to an aspect of 
the TTT program since participating in the site visit? 

Yes . . . 1[ ] No ... 21 ] 

22, (If yes) Indicate the nature of the commitment. 



23. (If no) Would you be willing to assist an aspect 
of the TTT program in a consultative role? 

Yas . . . 1[ ] No . . . 2[ ] 

24. If a friend of yours asked you to write a letter in 
support of the TTT National Program, could you in good 
conscience be supportive from what you know about the 
program? 

Yes . . . 1[ ] No . . . 2[ ] Undecided . . . 3[ ] 

25. Name a person with similar work responsibilities as 
yourself who favorably views the TTT program. 

Name 

Title/Position 

Address 

26. Please indicate a primary aspect of the program on 
which this person bases his favorable attitude. 



# 



o 
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